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1 Introduction 

This paper is devoted to heuristic aspects of the so-called idempotent cal- 
culus. There is a correspondence between important, useful and interest- 
ing constructions and results over the field of real (or complex) numbers 
and similar constructions and results over idempotent semirings in the spirit 
of N. Bohr's correspondence principle in Quantum Mechanics. Idempotent 
analogs for some basic ideas, constructions and results in Functional Anal- 
ysis and Mathematical Physics are discussed from this point of view. Thus 
the correspondence principle is a powerful heuristic tool to apply unexpected 
analogies and ideas borrowed from different areas of Mathematics and The- 
oretical Physics. 

It is very important that some problems nonlinear in the traditional sense 
(for example, the Bellman equation and its generalizations and the Hamilton- 
Jacobi equation) turn out to be linear over a suitable semiring; this linearity 
considerably simplifies the explicit construction of solutions. In this case we 
have a natural analog of the so-called superposition principle in Quantum 
Mechanics (see 0-0]). 

The theory is well advanced and includes, in particular, new integration 
theory, new linear algebra, spectral theory and functional analysis. Appli- 
cations include various optimization problems such as multicriteria decision 
making, optimization on graphs, discrete optimization with a large parameter 
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(asymptotic problems), optimal design of computer systems and computer 
media, optimal organization of parallel data processing, dynamic program- 
ming, discrete event systems, computer science, discrete mathematics, math- 
ematical logic and so on. See, for example, [|J-|>4|]. Let us indicate some 
applications of these ideas in mathematical physics and biophysics ||65||-||70| . 



In this paper the correspondence principle is used to develop an approach 
to object-oriented software and hardware design for algorithms of idempotent 
calculus and scientific calculations. In particular, there is a regular method 
for constructing back-end processors and technical devices intended for an 
implementation of basic algorithms of idempotent calculus and mathematics 
of semirings. These hardware facilities increase the speed of data processing. 
Moreover this approach is useful for software and hardware design in the 
general case of algorithms which are not 
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'idempotent' 

The paper contains a brief survey of the subject but our list of references is 
not complete. Additional references could be found in |PH, Hl4f, fl5 



I3, 13-11, H, 11' H; the corresponding lists of references 



are not complete too but very useful. 
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2 Idempotent quantization and 
dequantization 

Let R be the field of real numbers, E + the subset of all non-negative num- 
bers. Consider the following change of variables: 

u 1— > w = hhau, (1) 

where u E E + , h > 0; thus u = e w ^ h , wGl. We have got a natural map 

D h : R+ -> A = RU {-00} (2) 

defined by the formula (2.1). Denote by (D the "additional" element —00 
and by I the zero element of A (that is I = 0); of course (D = Dh(0) and 
2 = -0^(1)- Denote by Ah the set A equipped with the two operations © 
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(generalized addition) and (generalized multiplication) borrowed from the 
usual addition and multiplication in R + by the map D^, thus Wi Q W2 = 
Wi + u>2 and w\ ® 102 = h\n(e Wl ^ h + e W2 ^ h ). Of course, Dh(u\ + 112) = 
Dh(ui) ® Dh(u2) and Dh(uiu 2 ) = Dh{u\) Dh{u-i). It is easy to prove that 
Wl © w 2 = hln(e wi/h + e W2/h ) -> max-fwi, w 2 } as h -> 0. 

Let us denote by M max the set A = R U {—00} equipped with operations 
© = max and = +; set (D = —00, 1 = 0. Algebraic structures in R + and 
Ah are isomorphic, so IR max is db result of a deformation of the structure in R+. 
There is an analogy to the quantization procedure, and h is an analog for the 
Planck constant. Thus M + (or M) can be treated as a "quantum object" with 
respect to R max and M max can be treated as a "classical" or "semiclassical" 
object and as a result of a "dequantization" of this quantum object. 

Similarly denote by M min the set R U {+00} equipped with operations 
© = min and = +; in this case (D = +00 and 1 = 0. Of course, the change 
of variables u 1— > w = —hlnu generates the corresponding dequantization 
procedure for this case. 

The set M U {+00} U { — 00} equipped with the operations © = min and 
= max can be obtained as a result of a "second dequantization" with 
respect to R (or R + ). In this case (D = 00, l = —00 and the dequantization 
procedure can be applied to the subset of negative elements of R max and the 
corresponding change of variables is w 1— > v = h\n(—w). 

3 Semirings 

It is easy to check that for these constructed operations © and the 



following basic properties are valid for all elements o, b, c: 

(aQ)b) Q) c= a® (b® c); (a b) c = a (b c); (3) 

(D©a = a©(D = a; !0o = a0l = a; (4) 

0©a = a0fl) = fl); (5) 

a®(b®c) = (a®b)®(a®c)] (b ® c) Q a = (b Q a) © (c a); (6) 

a®b = b®a; (7) 

a©a = a; (8) 

a®b = b®a. (9) 
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A set A equipped with binary operations © and and having distin- 
guished elements (D and I is called a semiring, if the properties (axioms) 
(3.1), (3.2), (3.3), (3.4) and (3.5) are fulfilled. We shall suppose that 0^1. 

This semiring is idempotent if (3.6) is valid. Idempotent semirings are 
often called dioids. A semiring (maybe non-idempotent) is called commuta- 
tive, if (3.7) is valid. Note that different versions of this axiomatics are used, 
see, for example, @]-@, fl4l , [p0|l-|p4"|, [131' (HI an d some literature indicated 



in g. 

Example 3.1. The set R + of all nonnegative real numbers endowed with 
the usual addition and multiplication is a commutative (but not idempotent) 
semiring. Of course, the field R of all real numbers is also a commutative 
semiring. 

Example 3.2. K max and R m i n are isomorphic commutative idempotent 
semirings. 

Example 3.3. A = M + with the operations © = max and © = ■ (the 
usual multiplication); (D = 0, 1 = 1. This idempotent semiring is isomorphic 
to M ma x by the mapping x \— > ln(x). 

Example 3.4. A = [a, b] = {x G K| a < x < b} with the operations 
© = max, = min and the neutral elements (D = a and 3 = 6 (the cases 
a = — oo, b = +oo are possible). • 

Semirings similar to these examples are the most close to the initial "quan- 
tum" object R + and can be obtained by dequantization procedures. However 
there are many important idempotent semirings which are unobtainable by 
means of these procedures. Note that there exist important quantum me- 
chanical systems which cannot be obtained from classical systems by quan- 
tization (for example, particles with spin and systems consisting of identical 
particles). Thus the situation is natural enough for our analogy. 

Example 3.5. Let Mat n (yl) be the set of n x n matrices with entries 
belonging to an idempotent semiring A. This set forms a noncommutative 
idempotent semiring with respect to matrix addition © and matrix multipli- 
cation 0, that is 



(X © Y)ij = Xt, © Yij and (X Y) t] = ® n k=l X ik Y h 



kj ■ 



Of course, ((D) y = (D G A, and (1)^ = <S\ E Aiii^ j, and (l) u = 1 G A. 

Example 3.6. A = {0, 1} with the operations © = max, = min, 
(D = 0, 1 = 1. This is the well-known Boolean semiring (or Boolean algebra). 
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Note that every bounded distributive lattice is an idempotent semiring. 

Example 3.7. A = {(D, 1, a}, where {(D, 1} is a Boolean semiring, (D©a = 
a, (D a = (D, 1Q a — a, I © a = I, a® a — a, aQ a — a. This example can 
be treated as a three- valued logic. • 

There are many finite idempotent semirings; a classification of commu- 
tative idempotent semirings consisting of two, or three, or four elements is 
presented in |52| . 

Example 3.8. Let A be the set of all compact convex subsets of R n (or 
of any closed convex cone in R n ); this set is an idempotent semiring with 
respect to the following operations: 

a © = convex hull of a and 0; 
aQ0 = {a + b \ a G a,b G 0} 

for all a, G A; (D = 0, 1 = {0}. This idempotent semiring is used in math- 
ematical economics and in the multicriterial optimization problem (evolution 
of the so-called Pareto sets; see, for example PS| , |74| ). 



Example 3.9. If A\ and A2 are idempotent semirings, then A = A\ x A2 
is also an idempotent semiring with respect to the natural component-wise 
operations of the direct product; in this case (Q),(D) and (I, I) are the cor- 
responding neutral elements. A similar (and natural, see construction 
turns (Al\{(D}) x (A 2 \{(D}) U (D into an idempotent semiring. • 

Probably the first interesting and nontrivial idempotent semiring of all 
languages over a finite alphabet was examined by S. Kleene [[F3| in 1956. 
This noncommutative semiring was used for applications to compiling and 
syntax analysis, see also |J, 0. There are many other interesting examples 
of idempotent semirings (including the so-called "tropical" semirings, see, for 
example, ||7[], fI5[] , [pOU , p3"| , p^| ) with applications to theoretical computer 



science (linguistic problems, finite automata, discrete event systems and Petri 
nets, stochastic systems, computational problems etc.), algebra (semigroups 
of matrices over semirings), logic, optimization etc.; in particular, see also 

§-0, 0, 0, Eg, 0-0, 0-0, m-m 



There is a naturally defined partial order (i.e. partial ordering relation) 
on any idempotent semiring (as well as on any idempotent semigroup); by 
definition, a ^ b if and only if a © b = b. For this relation the reflexivity 
is equivalent to the idempotency of the (generalized) addition, whereas the 
transitivity and the antisymmetricity follow, respectively, from the associa- 
tivity and from the commutativity of this operation. This ordering relation 
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on K max (as well as on semirings described in the examples 3.3 and 3.4) coin- 
cides with the natural one but for R min it is opposite to the natural ordering 
relation on the real axis. 

Every element a of an idempotent semiring A is "nonnegative" : (D ^ a; 
indeed, (D © a = a because of (3.2). Similarly, for all a,b,c G ^4 we have 
a © c -< b © c, and a Q c ^ b Q c if a ^ b. 

Using this standard partial order it is possible to define in the usual way 
the notions of upper and lower bounds, bounded sets, sup M and inf N for 
upper/lower bounded sets M and N etc. On the basis of these concepts an 
algebraic approach to the subject is developed, see, for example, [|J-|§, PTj , 

n, n, & ~ 



T9f-|4 



53]. 



An idempotent semiring can be a metric or topological space with natural 
correlations between topological and algebraic properties. For example, for 



there is a natural metric p(x, y) 



— e 



and for the semiring 



from Example 3.4 it is convenient to use the metric p(x,y) = | arctanx — 



arctany| if a = — oo, b 



was developed, e.g. in [O. 



-oo. 
PI, 



The corresponding "topological" approach 

11-121, [i39ii, ra, pi-pi, m-m. 



4 Semirings with special properties 

It is convenient to treat some special classes of semirings for which some 
additional conditions are fulfilled. Let us discuss some conditions of this 
type. 

Suppose A is an arbitrary semiring. The so-called cancellation condition is 
fulfilled for A if b = c whenever a © b = a c and a ^ I. If the multiplication 
in A is invertible on A\{(D}, then A is called a semifield. Of course, the 
cancellation condition is fulfilled for all semifields. For example, M max is a 
semifield. Idempotent semirings with the cancellation condition or with an 
idempotent multiplication are especially interesting. 

For arbitrary commutative idempotent semirings with the cancellation 
condition the following version of Newton's binomial formula is valid: 

(a®b) n = a n ®b n , (10) 



sec 



3^1 , |p3| . However, this formula is valid also for semirings from Example 
3.4 which have no the cancellation condition. It is easily proved (by in- 
duction) that for arbitrary commutative idempotent semirings this binomial 
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formula has the form 

n 

(ae&) n = ®fl n " ! 0fc l . (11) 

Suppose A is an arbitrary idempotent semiring. Applying (4.2) to the 
semiring generated by elements 3, a G A, we deduce the following formula: 

(I©a) n = I©a©a 2 ©---©a n . (12) 

Now let A be an arbitrary semiring (maybe non-idempotent) and suppose 
that the following infinite sum 

oo 

a * =©«' = 2©a©a 2 ©---©a n --- (13) 

is well-defined for an element a G A. For concrete semirings a* may be 
defined, e.g. as sup {( II + a) n } or lim(l©a) n . This important star operation 

dHfl* was introduced by S. Kleene [73| ; the element a* is called a closure 
of a. 

It is natural to set a* = (1 — a) -1 if A is a field and a / 1. It is easy to 
prove that a* = 1, if A is an idempotent semiring and a ^ 1. For M max the 
closure a* is not defined if 1 -< a. The situation can be corrected if we add 
an element oo such that a © oo = oo for all G R max , (D©oo = (D, a©oo = oo 
for all a ^ (D. For this new semiring M max = M max U {oo} we have a* = oo if 
2 -< a, see e.g. [|TB|, PDf . For all semirings described in the examples 3.4, 3.6 
and 3.7 we have a* = II for any element a. 

An idempotent semiring A is algebraically closed (with respect to the 
operation ©) if the equation x n = a (where x n = x Q ■ ■ ■ Q x) has a solution 
x G A for any a £ A and any positive integer n, see , |3B| . It is remarkable 
and important that the semiring M max is algebraically closed in this sense. 
However, the equation x 2 © 1 = (D has no solutions. 

5 Correspondence principle 

The analogy with Quantum Mechanics discussed in section 2 leads to the 
following correspondence principle in idempotent calculus: 

There is a (heuristic) correspondence between important, useful and in- 
teresting constructions and results over the field of real (or complex) numbers 
(or the semiring of all nonnegative numbers) and similar constructions and 
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results over idempotent semirings in the spirit of the correspondence principle 
in Quantum Mechanics. 



Example 5.1. Semimodules (see e.g. 0-0, (XTf, 0, |2[, 

33| , p0|-|53|). A set V is called a semimodule over a semiring A (or an 
A-semimodule), if there is a commutative associative addition operation © 
in V with neutral element 0, and a multiplication © of elements from V by 
elements of A is defined, and the following properties are fulfilled: 

(A y) v = A (// v) for all A, fi G A, v G V; 

A (ui © ua) = A vi © A v 2 for all A G A, v u v 2 eV; 

(D0f = A0(D = (D for all A G A, u G V. 

The addition © in V is assumed to be idempotent if A is an idempotent 
semiring (i.e. v © v = v for all v G V). Then we assume that 

sup{A a } f = sup{A Q u}, if v G V and sup{A a } G A. 

Roughly speaking, semimodules are "linear spaces" over semirings. The 
simplest A-semimodule is the direct sum (product) A n = {(ai, a 2 , ■ ■ ■ , a n ) : 
aj G A}. The set of all endomorphisms A n — > A n coincides with the semiring 
Mat ra (74) of all A-valued matrices (see Example 3.5 in Section 3). 

The theory of A- valued matrices is an analog of the well-known O. Perron- 
G. Frobenius theory of nonnegative matrices, see e.g. [ff5[| . For example, 



let A be an algebraically closed commutative idempotent semiring with the 
cancellation condition and the sequence a n © b stabilizes for any a ^ 1 and 
b 7^ (D, a,b G A. Then for every endomorphism K of A n (n > 1) there 
exists a nontrivial subsemimodule S <Z A n (an "eigenspace" ) and A G A (an 
"eigenvalue") such that Kv = XQv for all v G S; this element A is unique if K 
is irreducible, see In particular, this result is valid if A = R max (or 

^min) • Similar results can be proved for semimodules of bounded functions 
and continuous functions, see [|3"2| , |33| , p2[ - [p^] . • 



Idempotent analysis deals with functions taking values in idempotent 
semirings and with the corresponding function spaces (semimodules). Let X 
be a set and A an idempotent semiring. Let us denote by B(X, A) the set of 
all bounded mappings (functions) X — > A (i.e. mappings with order-bounded 
images) equipped with a natural structure of an A-semimodule. If X is finite, 
X = {xi, . . . , x n }, then B(X, A) can be identified with the semimodule A n 
(see Example 5.1 above). Actually B(X,A) is an idempotent semiring with 
respect to the corresponding pointwise operations. 
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Let A be a metric semiring; then there is the corresponding uniform 
metric on B(X,A). Suppose that X is a topological space and then denote 
by C(X,A) the subsemimodule of continuous functions in B(X,A). 

Suppose now that the space X is locally compact and then denote by 
Cq(X, A) the A-semimodule of continuous A- valued functions with compact 
supports endowed with a natural topology (see |Tj| - |24j] for details). 

These spaces (and some other spaces of this type) are examples of "idem- 
potent" function spaces. Many basic ideas, constructions and results can be 
borrowed to idempotent analysis from usual analysis and functional analysis. 

Example 5.2. Idempotent integration and measures. For the 
sake of simplicity set A = K max and let X be a locally compact space. An 
idempotent analog of the usual integration can be defined by the formula 

r® 

/ ip(x) dx = sup (p(x), (14) 

JX x&X 

if (p is continuous or upper semicontinuous function on X. The set function 

m^B) = supip(x), (15) 
xeB 

where B C X is called an A-measure on X and m v (UB a ) = {&m v (B a ) = 

a 

supm (/3 (i3 Q ), so the function (5.2) is completely additive. An idempotent 

a 

integral with respect to this A-measure is defined by the formula 



tjj(x) drriu, = / ip(x) (p(x) dx = sup ip(x) (fix). (16) 
x Jx ' xe x 

It is obvious that this integration is "linear" over A and it is easy to see that 
(5.1) and (5.3) can be treated as limits of Riemann's and Lebesgue's sums. 
Of course, if © = min for the corresponding semiring A, then (5.3) turns into 
the formula 



ip(x) dvn.n = / ip(x) ip(x) dx = inf ijj(x) <p(x). (17) 

X JX oc&X 

In this case, may coincide e.g. with max, or the usual addition or multi- 



plication. See 0, p[, - @ for details. • 

Note that in (5.4) we mean inf (i.e. the greatest lower bound) with 
respect to the usual ordering of numbers. But if © = min, then this order is 
opposite to the standard partial order defined for any idempotent semiring 
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(see Section 3 above). It is clear that (5.3) and (5.4) coincide from this point 
of view. In general case A-measure and idempotent integral can be defined 
by (5.2) and (5.3), e.g. if the corresponding functions are bounded and A is 
boundedly complete, i.e. every bounded subset B C A has the least upper 
bound sup B. 

There is a natural analogy between idempotent and probability measures. 
This analogy leads to a parallelism between probability theory and stochastic 
processes on the one hand, and optimization theory and decision processes 
on the other hand. That is why it is possible to develop optimization the- 
ory at the same level of generality as probability and stochastic processes 
theory. In particular, the Markov causality principle corresponds to the 
Bellman optimality principle; so the Bellman principle is an R max -version of 
the Chapman-Kolmogorov equation for Markov stochastic processes, see e.g. 

[Z4[ |, PB| , P5| , J5E|| , p3"[ . Applications to the filtering theory can be 



found in [0, |§. 

Example 5.3. Group idempotent (convolution) semirings. Let G 

be a group, A an idempotent semiring; assume that A is boundedly complete. 
Then the space B(G, A) of all bounded functions G — > A (see above) is an 
idempotent semiring with respect to the following idempotent analog © of 
convolution: 

{(p®ip){g)= I (p(x)Oi/j(x ■ g)dx. (5.5)« 

J G 

Of course, it is possible to consider other "function spaces" instead of 
B{G,A). In [23|, semirings of this type are referred to as convolution 



semirings. 

Example 5.4. Fourier— Legendre transform, see [fH}| , M, fID|-|2"4]|. 



Let A = K max , G = M n and G is treated as a group. The usual Fourier- 
Laplace transform is defined by the formula 

<p(x) i-> = f e^ x tp(x)dx, (6) 

where e % ^' x is a character of the group G, that is a solution of the following 
functional equation: 

f(x + y) = f(x)f(y). 
The corresponding idempotent analog ( for the case A = M ma x) has the form 

f(x + y)=f(x)Qf(y)=f(x)+f(y), 
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so "idempotent characters" are linear functionals x i— > £-x = £1X1 + • • -+£^71- 
Thus (5.6) turns into the following transform: 



cp(x) ^ = / £-x ip(x)dx = sup(£-x + ip(x)). (7) 

This is the famous Legendre transform. Thus this transform is an M max - 
version of the Fourier-Laplace transform.* 

Of course, this construction can be generalized to different classes of 
groups and semirings. Transformations of this type convert the generalized 
convolution to pointwise multiplication and possesses analogs of some impor- 
tant properties of the usual Fourier transform. For the case of semirings of 
Pareto sets the corresponding version of the Fourier transform reduces the 
multicriterial optimization problem to a family of singlecriterial problems 



[35 



The examples 5.3 and 5.4 can be treated as fragments of an idempotent 
version of the representation theory. In particular, idempotent represen- 
tations of groups can be examined as representations of the corresponding 
convolution semirings (i.e. idempotent group semirings) in semimodules. 

According to the correspondence principle, many important concepts, 
ideas and results can be converted from usual functional analysis to idempo- 
tent analysis. For example, idempotent scalar product can be defined by the 
formula: 

(<P,4>) = I p(x)Q*p(x)dx, (8) 

where (p, x/j are A-valued functions belonging to a certain idempotent function 
space. There are many interesting spaces of this type including B(X,A), 
C(X,A), Co(X,A), analogs of the Sobolev spaces and so on. There are 
analogs for the well-known theorems of Riesz, Hahn-Banach and Banach- 
Steinhaus; it is possible to treat dual spaces and operators, an idempotent 
version of the theory of distributions (generalized functions) etc.; see [[I9f- 



g, H, & B> I!! for details. 
Example 5.5. Integral operators. It is natural to construct idempo- 
tent analogs of integral operators in the form 

K:ip(y)^ (Kp) (x) = J® K(x, y) <p(y)dy, (9) 

where (p(y) is an element of a space of functions defined on a set Y and taking 
their values in an idempotent semiring A, (K(p)(x) is an A-valued function 
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on a set X and K(x, y) is an ^-valued function on X x Y . If A 
(5.9) turns into the formula 

(K<p)(x) = sup{K(x,y) +tp(y)}. 

y&Y 



then 



(10) 



Formulas of this type are standard for optimization problems, see e.g. 77 



It is easy to see that the operator defined by (5.9) is linear over A, i.e. 
K is an A-endomorphism of the corresponding semimodule (function space). 
Actually every linear operator acting in an idempotent function space and 
satisfying some natural continuity-type conditions can be presented in the 
form (5.9). This is an analog of the well-known L. Schwartz kernel theorem. 
The topological version of this result in spaces of continuous functions was 
established in 



7811, 1731; see also 



theorem for the space of bounded functions see in |32 
form) in ||52|. 



21]. The algebraic version of the kernel 

and (in a final 
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6 Superposition principle 

In Quantum Mechanics the correspondence principle means that the Schro- 
dinger equation (which is basic for the theory) is linear. Similarly in idempo- 
tent calculus the correspondence principle means that some important and 
basic problems and equations (e.g. optimization problems, the Bellman equa- 
tion and its generalizations, the Hamilton- Jacobi equation) nonlinear in the 
usual sense can be treated as linear over appropriate idempotent semirings, 
see i-i, |1J-|1. 



Example 6.1. Idempotent dequantization for the heat equation. 

Let us start with the heat equation 

du hd 2 u . . 

dt = 2 3^' ( ' 

where x G R, t > 0, and h is a positive parameter. 
Consider the following change of variables: 

u i — ► w — —h In u; 

it converts (6.1) to the following (integrated) version of the Burgers equation: 

dw ^ 1 fdw\ 2 hd 2 w q 
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This equation is nonlinear but it can be treated as linear over the follow- 
ing generalized addition © and multiplication (borrowed from the usual 
addition and multiplication by the change of variables): 

Wl © W2 = -h ln{e- Wl/h + e ~ W2/h ) , (13) 

Wi w 2 = wi + w 2 . (14) 

So if Wi and w 2 are solutions for (6.2), then their linear combination with 
respect to the operations (6.3) and (6.4) is also a solution for this equation. 
For h — > (6.2) turns into a special case of the Hamilton-Jacobi equation: 

dw if dw\ 2 n 

arM&j ="■ < 15 > 

This is the dequantization procedure described in Section 2 above. So it is 
clear that (6.3) and (6.4) turn into addition © = min and multiplication 
= + in the idempotent semiring R min and the equation (6.5) is linear 
over R m i n ; thus the set of solutions for (6.5) is an M min -semimodule. This 
example was the starting point for the well-known Hopf method of vanishing 
viscosity.* 

In general case the Hamilton-Jacobi equation has the following form: 



dS(x,t) 
dt 



H(§,x,t)=0, (16) 



where if is a smooth function on K 2n x [0, T\. Consider the Cauchy problem 
for (6.6): S(x,0) = S (x), < t < T, x G R n . Denote by U t the resolving 
operator, i.e. the map that assigns to each given S (x) the solution S(x,t) 
of this problem at the moment of time t. Then the map Ut for each t is a 
linear (over IW n ) integral operator in the corresponding ]R m i n -semimodule. 

The situation is similar for the Cauchy problem for the homogeneous 
Bellman equation 

f + i/(f)=0, S\ t=0 = S (x), 
where H: R n — > R is a convex (not strictly) first order homogeneous function 

H{p) = sup {f-p + g), f G R n , g E R, 

(f,g)ev 



and V is a compact set in R n+ . See p3 |, |24j1 , [39] , |76| for details. 
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It is well-known that discrete version of the Bellman equation can be 
treated as linear over idempotent semirings. The so-called generalized sta- 
tionary (finite dimensional) Bellman equation has the form 

S = HS®F, (17) 

where S, H, F are matrices with elements from an idempotent semiring A 
and the corresponding matrix operations are described in Example 3.5 above 
(for the sake of simplicity we write HS instead of HQS); the matrices H and 
F are given (specified) and it is necessary to determine S from the equation. 
The equation (6.7) has the following solution: 

S = H*F, (18) 

where H* is the closure of H G Mat n (v4), see Section 4 and Example 3.5 
above. Recall that 

H* = 1 © H © H 2 © . . . © H k © . . . , (19) 

if the right-hand side of (6.9) is well-defined. In this case H* = 1 © HH*, 
so H*F = F © HH*F; thus (6.8) is a solution of (6.7). For example, if 
the sequence H^ N > = Y,k=o H k stabilizes (i.e. there exists N such that 
H (N) _ H (N ) for all N > N ), then (6.9) is well-defined and can be calculated 
by means of a finite set of operations (steps) . 

This consideration and a version of the Gauss elimination method for 



solving (6.7) were presented by S. Kleene |73| in the case of the semiring of all 
languages over a finite alphabet. B. A. Carre @] used semirings to show that 
many important problems for graphs can be formulated in a unified manner 
and are reduced to solving systems of algebraic equations. For example, 
Bellman's method of solving shortest path problems corresponds to a version 
of the Jacobi method for solving (6.7), whereas Ford's algorithm corresponds 
to a version of the Gauss-Seidel method. The further development of this 



subject see in §-[0, 0-0, 0-0, @, 0. 



Let A be a semiring (maybe non-idempotent). For each square n x n 
matrix H = (hij) G M&t n (A) there is a standard way to construct a geomet- 
rical object called a weighted directed graph. This object consists of a set X 
of n elements x\, X2, ■ ■ ■ , x n together with the subset T of all ordered pairs 
(xi, Xj) G X x X such that hij ^ fl) and the mapping h: T — > A\{&} given by 
the correspondence (xi,Xj) i— > h^. The elements of X are called nodes, and 
the members of T are called arcs; hij are arc weights. 
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In other terms the quadruple M(X, T, h, A) can be treated as a discrete 
medium with the points x iy the set T of links and the so-called link character- 
istics h. This concept is convenient for analysis of parallel computations and 
for synthesis of computing media. Mathematical aspects of these problems 



are examined in |14| ; the further development of the subject is presented e.g. 
in |g, H; see also |23|, |4|, [0, 0- For example, the operating 



period evaluation problem for parallel algorithms and digital circuits leads 
to shortest path problems for M(X, T, h, A), where A = K max - 
Recall that a sequence of nodes and arcs of the form 

V = (yo,ai,yi,a 2 ,y2, ■ ■ -,a k ,y k ), (20) 

where k > 0, jji are nodes of the graph, and ai are arcs satisfying ai = 
(yi-i,yi), is called a path (of order k) from the node yo to the node y k in 
M(X, T, h, A). The weight h(p) of the path (6.10) is a product of the weights 
of its arcs: 

h(p) = h{a x ) h{a 2 ) . . . h(a k ). (21) 

The so-called Algebraic Path Problem is to find the following matrix D = 
(dij): 

d l3 = ® p h(p) } (22) 

where i, j = 1,2, ... ,n, and p runs through all paths from Xi to Xj. A solution 
to this problem does not need to exist (the set of weights in (6.12) may be 
infinite). However, if there exists a closure H* of the matrix H = (hij), then 
the matrix 

D = (dy) = H* = l®H®H 2 ®...®H k ®... (23) 

can be treated as a solution of this problem. Moreover, H k corresponds to the 
value ® p h(p), where p contains exactly k arcs. For example, h\J = ® k= ihi k (D 

h k j are elements (coefficients) of H 2 , and each coefficient hfj corresponds to 
@ p h(p), where p runs through paths from Xj to Xj with exactly two arcs; 
similarly, H 3 = H 2 H, etc. 

Example 6.2. The shortest path problem. Let A = R. min , so hij are 
real numbers. In this case 

dij = ® p h(p) = min h(p), 

where (6.11) has the form 

h(p) = h(ai) + h(a 2 ) + . . . + h(a k ). 
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Example 6.3. The relation closure problem. Let A be the Boolean 
semiring (see Example 3.6 in Section 3 above). In this case H corresponds to 
a relation R C X x X , hij being 1 if and only if the relation holds between 
Xi and Xj. Then the transitive and reflective closure R* of the relation R 
corresponds to the matrix D = H*. 

Example 6.4. The maximal (minimal) width path problem. Let 
A be a semiring RU{— oo}U{oo} with the operations © = max and = min 
(see Example 3.4). Then 

dij = ® p h(p) = max/i(p), 

where h(p) = mm{h(ai), h(a 2 ), ■ ■ ■ , h(ak)}- If h(ai) is the width (or channel 
capacity) of a^, then h(p) is the possible width (or channel capacity) of p. 

Example 6.5. The matrix inversion problem. Let A be the field R 
of real numbers (which is not an idempotent semiring). In this case 

D = H* = 1 + H + H 2 ... = (1- H)-\ 

if the series J2kLo H h converges; if the matrix I — H is invertible, then (I — 
H) -1 can be treated as a "regularized" sum of this series; here H° = II is the 
identity matrix. 

Example 6.6. A simple dynamic programming problem. Let 

A = M m ax, so are real numbers. Let us consider as a profit of moving 
from Xi to xj, and suppose fa is a terminal prize for the node Xi (fi G E). 
Assume that p is a path of the form (6.10) and yo = Xj. Let M be a total 
profit for p, that is 

M = h{a x ) + h{a 2 ) + ... + h{a k ) + f{y k ). 

It is easy to see that maxM = {H k f) i) where / is a vector {fi}, H,H k G 
Mat n (A). So, the maximal value of the total profit for k steps is (H k f)i. It 
is clear that the maximal value of the total profit for paths of arbitrary order 
is maxM = (H*f)i.» 

See many other examples and details (including semiring versions of linear 
programming) in @-|7|, 0, 0, 0, Q, @. The book 



27j of F. L. Baccelli, G. Cohen, G. J. Olsder and J. -P. Quadrat is particularly 
useful. 
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7 Correspondence principle for algorithms 



Of course, the correspondence principle is valid for algorithms (as well as 
for their software and hardware implementations). Thus: 

If we have an important and interesting numerical algorithm, then we 
have a good chance that its semiring analogs are important and interesting 
as well. 

In particular, according to the superposition principle, analogs of lin- 
ear algebra algorithms are especially important. Note that numerical algo- 
rithms for standard infinite-dimensional linear problems over semirings (i.e. 
for problems related to integration, integral operators and transformations, 
the Hamilton-Jacobi and generalized Bellman equations) deal with the cor- 
responding finite-dimensional (or finite) "linear approximations" . Nonlinear 
algorithms often can be approximated by linear ones. Recall that usually 
different natural algorithms for the same optimization problem correspond 
to different standard methods for solving systems of linear equations (like 
Gauss elimination method, iterative methods etc.). 

It is well-known that algorithms of linear algebra are convenient for par- 



allel computations (see, e.g. |pl|-|l84[); so, their idempotent analogs accept a 
parallelization. This is a regular way to use parallel computations for many 
problems including basic optimization problems. 

Algorithms for the "scalar" (inner) product of two vectors, for matrix 
addition and multiplication do not depend on concrete semirings. Algorithms 
to construct the closure H* of an "idempotent" matrix H can be derived 
from standard methods for calculating (I — H)~ l . For the Gauss- Jordan 



elimination method (via LU-decomposition) this trick was used in [30], and 



the corresponding algorithm is universal and can be applied both to the 
general algebraic path problem and to computing the inverse of a real (or 
complex) matrix (1 — H). Computation of H~ l can be derived from this 
universal algorithm with some obvious cosmetic transformations. 

Note that numerical algorithms are combinations of basic operations. 
Usually these basic operations deal with "numbers". Actually these "num- 
bers" are thought as members of some numerical domains (real numbers, 
integers, and so on). But every computer calculation deals with concrete 
models (computer representations) of these numerical domains. For exam- 
ple, real numbers can be represented as ordinary floating point numbers, or 
as double precision floating point numbers, or as rational numbers etc. Dif- 
ferences between mathematical objects and their computer models lead to 
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calculation errors. That is another reason to use universal algorithms which 
do not depend on a concrete semiring and its concrete computer model. 
Of course, one algorithm may be more universal than another algorithm of 
the same type. For example, numerical integration algorithms based on the 
Gauss-Jacobi quadrature formulas actually depend on computer models be- 
cause they use finite precision constants. On the contrary, the rectangular 
formula and the trapezoid rule do not depend on models and in principle can 
be used even in the case of idempotent integration. 

8 Correspondence principle for hardware 
design 

A systematic application of the correspondence principle to computer cal- 
culations leads to a unifying approach to software and hardware design. 

The most important and standard numerical algorithms have many hard- 
ware realizations in the form of technical devices or special processors. These 
devices often can be used as prototypes for new hardware units generated by 
substitution of the usual arithmetic operations for its semiring analogs and 
by addition tools for performing neutral elements (D and 1 (the latter usually 
is not difficult). Of course the case of numerical semirings consisting of real 
numbers (maybe except neutral elements) is the most simple and natural. 
Semirings of this type are presented in the examples 3.1-3.4. Semirings from 
the examples 3.6 and 3.7 can also be treated as numerical semirings. Note 
that for semifields (including R max and R m i n ) the operation of division is also 
defined. 

Good and efficient technical ideas and decisions can be transposed from 
prototypes into new hardware units. Thus the correspondence principle gen- 
erates a regular heuristic method for hardware design. Note that to get a 
patent it is necessary to present the so-called "invention formula", that is 
to indicate a prototype for the suggested device and the difference between 
these devices. A survey of patents from the correspondence principle point 
of view is presented in [82]. 

Consider (as a typical example) the most popular and important algo- 
rithm of computing the scalar product of two vectors: 

(x, y) = xiyi + x 2 y 2 + • • • + x n y n . (24) 
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The universal version of (8.1) for any semiring A is obvious: 



(x, y) = (xi © y x ) © (x 2 y 2 ) © • • • © (z„ y n )- (25) 
In the case A = K max this formula turns into the following one: 

(2, y) = max{xi + y 1} x 2 + y 2 , ■ ■ ■ , x n + y n }. (26) 

This calculation is standard for many optimization algorithms (see Sec- 
tion 6), so it is useful to construct a hardware unit for computing (8.3). There 
are many different devices (and patents) for computing (8.1) and every such 
device can be used as a prototype to construct a new device for computing 
(8.3) and even (8.2). Many processors for matrix multiplication and for other 
algorithms of linear algebra are based on computing scalar products and on 
the corresponding "elementary" devices respectively, etc. 

There are some methods to make these new devices more universal than 
their prototypes. There is a modest collection of possible operations for 
standard numerical semirings: max, min, and the usual arithmetic opera- 
tions. So, it is easy to construct programmable hardware processors with 
variable basic operations. Using modern technologies it is possible to con- 
struct cheap special-purpose multi-processor chips implementing examined 
algorithms. The so-called systolic processors are especially convenient for 
this purpose. A systolic array is a "homogeneous" computing medium con- 
sisting of elementary processors, where the general scheme and processor 
connections are simple and regular. Every elementary processor pumps data 
in and out performing elementary operations in a such way that the corre- 
sponding data flow is kept up in the computing medium; there is an analogy 
with the blood circulation and this is a reason for the term "systolic", see 
e.g. @, @. 



Concrete systolic processors for the general algebraic path problem are 
presented in [[Kj, |3~Ifl . In particular, there is a systolic array of n{n + 1) 



elementary processors which performs computations of the Gauss- Jordan 
elimination algorithm and can solve the algebraic path problem within 5n — 2 
time steps. Of course, hardware implementations for important and popular 
basic algorithms increase the speed of data processing. 
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9 Correspondence principle for software 
design 

Software implementations for universal semiring algorithms are not so effi- 
cient as hardware ones (with respect to the computation speed) but are much 
more flexible. Program modules can deal with abstract (and variable) oper- 
ations and data types. Concrete values for these operations and data types 
can be defined by input data types. In this case concrete operations and data 
types are defined by means of additional program modules. For programs 
written in this manner it is convenient to use a special techniques of the so- 



called object-oriented design, see e.g. [71|. Fortunately, powerful tools sup 



porting the object-oriented software design have recently appeared including 
compilers for real and convenient programming languages (e.g. C ++ ). 

There is a project to obtain an implementation of the correspondence 
principle approach to scientific calculations in the form of a powerful soft- 
ware system based on a unifying collection of universal algorithms. This 
approach ensures a working time reduction for programmers and users be- 
cause of software unification. The arbitrary necessary accuracy and safety of 
numerical calculations can be ensured as well |72| . 

The system contains several levels (including the programmer and user 
levels) and many modules. Roughly speaking it is divided into three parts. 
The first part contains modules that implement finite representations of basic 
mathematical objects (arbitrary precision real and complex numbers, finite 
precision rational numbers, p-adic numbers, interval numbers, fuzzy num- 
bers, basic semirings and rings etc.). The second part implements univer- 
sal calculation algorithms (linear algebra, idempotent and usual analysis, 
optimization and optimal control, differential equations and so on). The 
third part contains modules implementing model dependent algorithms (e.g. 
graphics, Gauss- Jacobi type numerical integration, efficient approximation 
algorithms). The modules can be used in user programs written in C ++ . See 
[]72| for some details. 
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